Skip to content

New parser#17

Merged
F0lak merged 58 commits into
mainfrom
new-parser
Jun 10, 2026
Merged

New parser#17
F0lak merged 58 commits into
mainfrom
new-parser

Conversation

@F0lak

@F0lak F0lak commented Jun 10, 2026

Copy link
Copy Markdown
Owner

Summary

Completes the remaining work required for the initial ORef release.

Changes

  • Added parser test coverage
  • Added integration tests for document transformation workflows
  • Completed CI/CD pipeline configuration
  • Improved parser validation and error handling
  • Updated project documentation
  • Performed final cleanup and refactoring for release readiness

Testing

Unit Tests

  • Parser component tests
  • Node generation tests
  • Transformation pipeline tests

Integration Tests

  • End-to-end HTML → structured representation conversion
  • End-to-end structured representation → Markdown conversion

Manual Validation

  • Tested against real-world BYOND reference documentation
  • Verified generated output matches expected formatting
  • Confirmed CI pipeline executes successfully

Notes

This PR brings ORef to a releasable state and establishes the baseline architecture for future development. No major feature additions are planned before release; future work will focus on maintenance, compatibility improvements, and incremental enhancements.

F0lak added 30 commits May 29, 2026 21:34
@F0lak
initial commit
9252214
@F0lak
readme and gitignore
a6d9f53
@F0lak
requirements file added
bb5f8f8
@F0lak
update requirements and ci workflow
0537314
@F0lak
ci try 3
2c96033
@F0lak
ci try 4
5311ae5
@F0lak
update actions version in ci workflow
5f5f58f
@F0lak
deliberate tests
5330e5b
@F0lak
fixes tests
271d80a
@F0lak
ok i think this wraps the CI
0ecfa26
@F0lak
implements ref fetching from byond remote
fc47c2a 
includes 3 unit tests and update to CI flow
@F0lak
attempt fix of unit test suite
c3c38f9
@F0lak
adds CI badge to readme
686820f
@F0lak
reorganize src files, remove old_ files from repo
76eb86f
@F0lak
reorg source files
c7f8fc5
@F0lak
implements extracting reference content and building RefEntry objects
40d30e2
@F0lak
parses description lists
93cb252
@F0lak
cleans up a bit of naming and docstring formatting
99b33dc
@F0lak
adds encoded <a> tags and cleans up ref_splitter.py file
5c3e670 
implements unit tests for RefSplitter.encode_link()
@F0lak
cleans up and touches up tests
f3c2336
@F0lak
moves RefEntry to ref_splitter.py and renames ref_entry.py to ref_tre…
a988dde 
…e.py
@F0lak
renames ref_str to ref_info to be more clear what it is
af149bd
@F0lak
implements reftree building and markdown export
ec34528
@F0lak
fixes broken unit tests
4fb06b5
@F0lak
implements paragraph and codeblock parsing, as well as inline tag tok…
3239348 
…enization.\nalso clears cache and fixes gitignore
@F0lak
replaces INLINE_TAGs with a global TOKEN_TABLE
6438f8b
@F0lak
fixes markdown token formatting
5c558fc
@F0lak
fixes spaces within token blocks
a334d69
@F0lak
implements md link formatting
11bc682
@F0lak
fixes md file export pathing
359c85b
F0lak added 28 commits June 2, 2026 19:57
@F0lak
fixes several small issues encountered when running a full parse of t…
006bef3 
…he ref.
@F0lak
adds common fields to ref entry and no longer parses out remaining de…
376f3d7 
…sc_lists
@F0lak
testing automated commit messages in diary entry
09387a3
@F0lak
confirmed commit messages are added to diary
fb43433
@F0lak
test commit message format
9f6fe96
@F0lak
implements export as its own class. minor code reorganization
28c5f83 
adds in client_mouse_snapshot.md file for future e2e tests
@F0lak
implements p class tokens and adds markdown checks to token unit tests
78cbfd6
@F0lak
implements data-driven approach to p class tokenization
52e7852 
fixes typo in token_table for 'compatibility' tag
@F0lak
implements p_class token parsing
5fcc444
@F0lak
formatting cleanup pass
1878b48
@F0lak
implements test suite for export.py implementation
4bf457d
@F0lak
Add 'ref_splitter/' from commit '4bf457d3033c064f785a5e7944821ba7527f…
2e25fcc 
…3fb6'

git-subtree-dir: ref_splitter
git-subtree-mainline: d4c4045
git-subtree-split: 4bf457d
@F0lak
moves requirements into repo root folder
ce56052
@F0lak
removes local test files
d61c2c0
@F0lak
fixes module paths and cleans main.py
e0dfa0b
@F0lak
implements tqdm for cleaner cli output while parsing
3eb54bc
@F0lak
moves diary to open_ref root folder and adds commit message back into it
2b0bf34
@F0lak
fixes test suite
276e196
@F0lak
configures test file for ref_splitter tests and moves refsplitter fix…
8d8c9b6 
…ture to conftest and removes module scope
@F0lak
implements e2e test happypath using test file
13669f1
@F0lak
replaces remote ref with ref parsed with v2 parser program
51d470d
@F0lak
updates ci.yml to run all unit tests
091b80e
@F0lak
updates readme and addresses tests failing on runner
baf4921
@F0lak
testing fix on the runner
b544e59
@F0lak
attempts to correct runner errors _again_
89dcc17
@F0lak
fixes oopsie typo on ci.yml
5ec7ff7
@F0lak
testing runner again
cdcbf5c
@F0lak
Removing linux simulation and info test from suite (it has served its…
9cc5cec 
… purpose!)
@F0lak F0lak merged commit 513d890 into main Jun 10, 2026
1 check passed
@F0lak F0lak deleted the new-parser branch June 10, 2026 05:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@F0lak